Entropy numbers of convex hulls and an application to learning algorithms

نویسنده

  • Ingo Steinwart
چکیده

Given a positive sequence a = (an) ∈ lp,q, for 0 < p < 2 and 0 < q ≤ ∞, and a finite set A = {x1, . . . , xm} ⊂ l2 with |xi| ≤ a for all i = 1, . . . ,m we prove ‖(en(acoA))‖p,q ≤ cp,q √ log(m + 1) ‖a‖p,q , where en(acoA) is the n th dyadic entropy number of the absolutely convex hull acoA of A and cp,q > 0 is a suitable constant only depending on p and q. Moreover we show that this is asymptotically optimal in m for the most interesting case q = ∞. As an application we give an upper bound for the so-called growth function which is of special interest in the theory of learning algorithms. AMS classification: 41A46, 68T05

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Gelfand numbers and metric entropy of convex hulls in Hilbert spaces

We establish optimal estimates of Gelfand numbers or Gelfand widths of absolutely convex hulls cov(K) of precompact subsets K ⊂ H of a Hilbert space H by the metric entropy of the set K where the covering numbers N(K, ") of K by "-balls of H satisfy the Lorentz condition ∫ ∞ 0 ( log2N(K, ") )r/s d" <∞ for some fixed 0 < r, s ≤ ∞ with the usual modifications in the cases r = ∞, 0 < s < ∞ and 0 <...

متن کامل

Entropy of convex hulls--some Lorentz norm results

Let A be a subset of a type p Banach space E, 1 < p ≤ 2, such that its entropy numbers satisfy ( εn(A) ) n ∈ `q,s for some q, s ∈ (0,∞). We show ( en(acoA) ) n ∈ `r,s for the dyadic entropy numbers of the absolutely convex hull acoA of A, where r is defined by 1/r = 1/p′+1/q. Furthermore, we show for slowly decreasing entropy numbers that ( en(A) ) n ∈ `q,s implies ( en(acoA) ) n ∈ `p′,s for al...

متن کامل

Entropy Numbers of Linear Function Classes

This paper collects together a miscellany of results originally motivated by the analysis of the generalization performance of the “maximum-margin” algorithm due to Vapnik and others. The key feature of the paper is its operator-theoretic viewpoint. New bounds on covering numbers for classes related to Maximum Margin classes are derived directly without making use of a combinatorial dimension s...

متن کامل

On the Size of Convex Hulls of Small Sets

We investigate two di erent notions of \size" which appear naturally in Statistical Learning Theory. We present quantitative estimates on the fat-shattering dimension and on the covering numbers of convex hulls of sets of functions, given the necessary data on the original sets. The proofs we present are relatively simple since they do not require extensive background in convex geometry.

متن کامل

Inequalities of Ando's Type for $n$-convex Functions

By utilizing different scalar equalities obtained via Hermite's interpolating polynomial, we will obtain lower and upper bounds for the difference in Ando's inequality and in the Edmundson-Lah-Ribariv c inequality for solidarities that hold for a class of $n$-convex functions. As an application, main results are applied to some operator means and relative operator entropy.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2010